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Louring the latter port of 1346, instructions wore 

issued by the Commandant, U. S* Marino Corps, concerning 

the use and marking of the fitness report for non- 

commissioned officers of the V* C. Marine Corps* Home loss 

of effectiveness had been experienced, duo in part perhaps 

to the inexperience of the rating officers, but at any 

rate the ratings assigned appeared not to differentiate 

sufficiently between the various levels of qualification 

mid performance* There wus little spread in the distribution 
1 

of markings* Instructions Kero issued which Kill tend 
toward a wider spread, but nevertheless, the opportunity 
appeared for personal research in the field of rating scales, 
and it is hoped that this unofficial and independent work 
may contribute something to thope more intimately connected 
with the problem* The purpose of this project, then, is to 
construct a rating scale and, in the process, to snake some 
useful contribution to the problem of rating non-conmissioned 
officers of the first three pay grades in the 15. 6. Marine 
Corps* 


The word - "marking” will mean here the actual marks made 
by the reporting officer {used interchangeably with 
"rating officer”) on the rating scale. 
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A# Preliminary Considerations* 

Rpecifiotilly, It is believed by the writer that the 

prinary use of a rating scale for W0 9 b of the U. S* Marine 

Corps is to determine their relative fitness for promotion, 

and the problem immediately resolves itself into one of 

1 

meeting this requirement* The problem was limited to the 
construction of a rating scale proper and therefore docs not 
include a design for the entire fitness report, since the 
portion of the fitness report exclusive of the rating scale 
would seen to contain items which are properly matters for 
administrative policy determination. 

The scale is not intended for use in evaluating 
candidates for enlistment but It is to be confined to the 
process of merit rating KCO*s already la the service* Some 
secondary uses of the scale ares (l) to indicate general 
shortcomings in the calibre of HOO*© in the Karine Corps so 
that plans *for training or other remedial action can be 
initiated, and (£) to indicate where improvement might be 
node in the classification or recruitment policies. 


1) An implication here is that there must be sufficient 

differentiation between individuals do that a choice can 
be made* This does not necessarily imply n normal distri¬ 
bution of ratings. For a.discussion of this matter, eoo 
bill, Hobart L* efficiency Ratings * Personae! Journal, 
1937, 15, p». 330-w.iH. 




3. 

To satisfy the main requirement, every reasonable 
neons nuot be token to cause raters to distribute their ratings 
so that they sill be discriminatory. Methods that sill tend 
to caws© such a distribution are known and sill be presented# 

There are certain administrative problems which sill 
make it desireable to keep statistical work at a isinlnum. 
with thousands of ratings per year to handle, the staff for 
this work could easily become too large for its proportionate 
share of the budget and make the ns© of the scale too costly. 

In the lower echelons, few, if any, trained statisticians or 
statistical machinery will be available. iT*ac Usability 
nuet be a najor consideration in th® construction. of the scale. 

The scale should be practical in another way too. 

It is possible that a new technique of rating-scale construc¬ 
tion night prove to be a superior one, but it is the purpose 
of this project to construct a scale which could be put to 
itinediate use* To increase the scalo*s chance for is&todiat® 
practicability, no attempt will bo nudo to create a new 
technique. The scale will be built on principles and 
techniques which are already operating satisfactorily. 

It should bo borne in mind that for service purposes 
a scale should measure proficiency rather than ability. 

There is an opportunity for the scale to b© objective, since 
th© ratings can be based upon observed performance and the 
scale constructed with that x'act in mind. It would of course 
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be little satisfaction for o oOKtieneing officer to have 
a group of lIG.O’s of the highest ability who turned in 
poor performances* 

In this instance, at least, the success of & rating 
scale should fiepend (aside from its ability to discriminate) 
on the reactions of two groups: the persons rating and 
the persons being rated* If the persons rated do not have 
confidence in the scale and understand it, its adverse 
influence on morale night more than offset its value* 
Likewise, if the raters who use the scale neither under¬ 
stand it nor want to use.it, it will host certainly not be 
put to use in the way intended* all persons coming in 
contact with the scale uust be sufficiently interested in 

it to master its values and limitations, for no scale yet 

1 

devised approaches Inf suability* 

81th these considerations in mind, the turn now is 
toward the more specific end of choosing a scale* 


B. Types of Scales Considered* 

several types of scales were considered before a choice 


1) a n illustration is from Lwart. Seashore and Tiffin, 
a Factor Analysis of an Industrial merit hating Seale , 
journal of Applied Psychology, 19*1, vol* 2b* 

The authors analyzed a twclve-trc»lt scale using 
Thurstone’s method and found that two faotors accounted 
for nearly all of the total rating scores. Yet, even 
if a satisfactory two-factor scale were devised, its 
acceptance would be doubtful, for neither raters nor 
ratees in the luarine Corps would be likely to put much 
confidence in it* 




was made, Gucli methods as the "paired comparison" and 
the "order of ,merit" or "ranking", though not strictly 
rating scales, were noted In passing and discarded as 
being too laborious ns well as for being designed for 
small groups, Guilford gives sq.m© advantages of rating 
scales over the paired-car. per Ison and rank-order methods; 
among them are: (1) rating socles require less time* 

(2) the procedure is more interesting to the rater* 

(3) rating-scale methods have a wider range of applica¬ 
tion; (4) ratings can be determined with psychologically 

naive Judges who have had little training; and (5) rating 

1 

scales can be used to rate largo groups, 

the numericallrating a^ulc is one consisting of 

descriptive phrases to which numerical or letter values 

are assigned. Gome advantages of this type of scale ore 

{1} it is objective; i2) it is easy to ©core; (3) it is 

expedient to mark; (4) it is easy to construct; and 

(5) its fora tends to make it unnecessary t'or a rater to 

maintain a subjective standard with relation to a large 

group, Gome disadvantages ore: 11) fine gradations in 

scoring arc not feasible; (2) It is vulnerable to the 
2 

"halo effect". 

1) Guilford. J . I’.' ''' psychometric Method© . P, 280. 

2) The tendency for a rater to form a general impression 
of a person and rate him accordingly in a number of 

! characteristics. 


«« 




The mn- to~rg.an type of scale was formerly used by the 

Array. It has us its salient feature a ’’master scale” for 

1 

each character la tic rated. The ratex* selects individuals 
who are typical of the extremes and average of a character¬ 
istic and writes their nanus on hie personal master scale* 
its individuals are rated they are compared to tho master 
scale and rated accordingly* Skwae advantages of the r.cn- 
to-raan scale are; {1} the nunter scale is a theoretically 
stable standard; (s) it is easy to score; and (3) it is 
not difficult to construct. Disadvontagus are; (lj it 
is relatively abstract; (2) it is vulnerable to the halo 
effect; and {3i in use it has proved too cumbersome. 

The defined-groups method is a method of rating 
persons with regard to their standing within a definite 
group, o.g. low, wiudli* or hiAh in relation to that group, 
^coring nay be simply numerical according to the sub- 
group in which the person rated is placed or, if a line 
is placed opposite each characteristic, may be the measured 
distance of a check mark from an end of the line# Aomo 


rr The word ’’chartscteristic f? will be used throughout in 
lieu oX‘ the word ’’trait'* which is most frequently used 
In the ‘literature on rating scales. The reason for 
this is that some of the items included in the scale 
constructed are not traits so that ’’characteristics” 
was chosen as a more inclusive term* 

2} fccott, Ulothier, Mathewson, and Apriegel, Personnel 
Mana gem ent , p. 21b. . . 
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advantages of this type ere: (1) It is easy to nark; 

(2) it is easy to soox'e; and (5) it in easy to construct* 

It has the following disadvantages: {1} it is abstract; 

(2) it is difficult for ratexus to keep in mind the degree 

of a characteristic in terns of symbols; and (3) it ie 

vulnerable to the halo effect* 

*ihe check-list typo of scale as advocated by 

1 

Kichardecm arid Hud or uas considered* In this scale 
there are no divisions by charac twist ice* A large nimber 
of eta tenants, accurately scaled, are included, and the 
rotor norely checks those applicable to the person rated* 
Advantages of bid's so^le are: Cl} It ie objective; {2} it 
tends to minirsiae the halo effect; (3) it eliminates the 
necessity for a rater \o nulntain a subjective standard 
with relation to a large group; end (4) its reliability 
has been shown to be relatively high* fo;>e of its disad¬ 
vantages are: (1) its proper construction requires the 
cooperation of a largo group; and (2) its application to 

l) M* 1 /• iiichartlson "and Q* F* Kuder, I'-ul- itu- a Hating He ale 
that Measures , ieraonnel Journal, 1933, vol* 12, 
pp* 30-40. 
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1 

ratine; characteristics is questionable• 

Army technicians have devised a new technique, the 
‘’foroed-cuoice*’ scale* Numerous descriptive items are 
selected and seeled in © manner alrailar to the check¬ 
list type* It is generally characterized by a grouping 
of three of these items together and the raters having 

to make a choice for each item as to whether it describes 
2 

the "rate©" no at, intermediate or least* 8one advan¬ 
tages of the forced-choice scale are: (1) it is objective 
(2) it tends to minimize the halo effect; and (3) it 
eliminates the necessity fee* a rater to maintain a 
subjective standard with relation to a large group* iioae 


Xj A study was mode of the monograph which would appear 
to bo the father of the scientific construction of 
such scales* (L* L* Thurstone and K* J. Chase, The 
14easurenoato of Attitudes ») 'i’hc writer cannot speak 
authoritatively, but he feels that there is not 
necessarily a logical transition frost the measures-ont 
of attitudes using this method to the rseaaurement of 
human characteristics. Thors tone’s measurements would 
soon to bo restricted to the measurement of attitude 
toward tt a ingle factor* >w*art, Seashore and Tiffin 
(a Foe tor Analysis of art Industrial ' merit hating ccale 
JournaSTof Applied Fsyohoiogy, 1941, vox* lb) found 
that at least two factors wore present in a rating 
scale (termed "ability to do the present job" and 
"skill over and above the requirements for the parti¬ 
cular job"). Most scales have more than t?/o item© 
to be rated. If tie can assume two or mores factors 
concerned in rating, than are these two factors 
properly weighted in the scientific check list? The 
items are nicely scaled, but in what proportion do 
they relate to the factors to be measured? 

2) The word "rate©" is used here to mean a person for 
whom a proflcien&y rating is determined with the aid 
of a rating scale* 
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disadvantages are: (l) its proper construction requires 
the cooperation of a large group; and (a ) complete data 
on its construction and use have not been publicized; 
and. (3j rotors have shown some resistance to it because 
it in difficult for a rater to tell how high or low he 
is rating. 

' The graphic rating scale has hod the nos* widespread 
use of any rating scale. II is characterised by a straight 
line opposite each characteristic. Beneath the line are 
ranged phrases descriptive of varying degrees of profi¬ 
ciency in a characteristic. The rater say check anywhere 
along the line he wishes, and the rating is converted to 
a numerical score through the use of a stencil. Some 
advantages of the scale are: (1) the scale is simple and 
expedient for the rater to use; (Hi it adapts to objecti¬ 
vity through the use of descriptive phrases; (s) it has 
had sufficient use to determine that it is well liked by 
tmn^ pfsrnoim using it; (4) it tends toward a normal dis¬ 
tribution of ratings since a rater can check anywhere 
along a line rather than on definite squares or symbols; 

(5) a great deal of recorded experience is available for 
use in the construction of such a scale; (6) its simplicity 
makes it easy to discuss o rating with a ratee; (?) its 
fora tends to ninimizo the necessity for a rater to main- 
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tain u subjective standard Kith relation to a large 
group; and {8} it is relatively easy to construct* A 
disadvantage Is that it is vulnerable to the halo effect* 
Weighing the advantages and disadvantages of the 
various scales directed attention to three types* the 
check-list, the forced-choice, and the graphic* The 
main objection to the check-list and forced-choice types, 
from the standpoint of this work, wes that the construc¬ 
tion of such scales is no one-nan Job within anything 
like a reasonable length of time, so that both were some- 
ulujt reluctantly discarded* 

The safest ground seeiicd to be in the direction of 
the graphic rating scale, ie a type which combines a ■ 
degree of objectivity Kith fine predations of scoring and 
yet remains relatively easy to construct* 

The graphic socle is m>t & solution to all problems 

of rating* Available figures show its reliability to be 

I 

somewhat less than that of the check-list type* It can 

Q 

only n ini mind the ’’halo effect* Xt does not eliminate 
variations in standards between raters but there ere 

XT "‘d*"'*-‘V'Burtt*" Implement 'Psychology . pp. 382-383* 

2) 3, ¥. Binghan, Palo Valid and Invalid , Journal of 

Applied Psychology* 1989, vol. 23, pp* 221-228 
states that a certain amount of this effect may be 
ties ir cable* 
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reasonably simple methods which tend to minimize th© 
variations* 

iron the factors considered, the graphic type of 
scale sms concluded to be the most practicable for this 
project* . - / 

C. Synthesis of lion© of the Principles of Constructing a 
GraphicBating Ccalo* 

lfroa the work of naoy persona, some established prin¬ 
ciples of rating-scale construction can be drawn* Many of 
there overlap sad the trading of information between the 
experts hea mado the original authors somewhat obscure* 
'ihoso listed below range from general rules to those 
applying particularly to the graphic scale* At least on© 
source for each rule will be indicated; although in 
nearly ©very case, several writers on th© subject of 
rating scales have substantiated each* 

1* ’ihorc is no one rating scale which is applicable 
1 

to all situations. 

2. In determining the characteristics to be used in 

a rating scale, the logical procedure is to consult persons 

who are familiar with th© occupations in question. The 

most frequently mentioned characteristics (in u survey) 
should be included in the final scale. * 

if u ii. i. 1 . Our t t, imiployrrant Psychoicv:y. r». 350. 

2) Ibid* p. 351. 
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3* Only those characteristics should be rated on a 

seal© that arc of greatest importance in the progress of 
1 

an individual. 

. ’ '' ' ", 2 

4. Items in scales must be observable* 

5. Xn order to miniala© halo effect, each character¬ 
istic should occupy a page by itself so that the rater can 

rate all his subordinates on a single characteristic before 

3,4 

rating any of them on any other characteristic. 

6* Characteristics should be grouped according to the 

b,6 

eccuracy with which they can be rated. 

7. The characteristic upon which a person is to bo 

7 

rated should be a simple one - not a compound one* 

6* The charnctoristic should bo defined and expressed 

u,a • 

objectively and not subjectively* 

9. The cimravteribtic should be defined and expressed 

10,11 

in terras of work porformed o* the job. 


lj oeott, Clothier, Mathews on, and 3prlegal, Personnel 
Manageme nt, p. 233. 

2) P. P. gymoiias, Dlngnoaim* Peraonollty and Conduct , p.84 
3} J, P. Guilford, Psychometric Methods , p* 271. 

4} Scott, Clothier, Mathewson, and opriegel, Personnel 
Management , p. 224. 

5) J» P. Guilford, Psychome trie Me thods . p. 278. 

6} P, Um mynonds, Diagnosing rar~onaIl'ty and Conduct , 
pp. 104-103. 

7) Dco.tt, Clothier, Mathewson, and Dpriegel, Personnel 
Management , p. 227. ~ 

3) ibiT,p. £gy. 

9} P. Lt» Symonds, Diagnosing Personality and conduct , p.85 
lo) Scott, Clothier, Mothewstm, and iipricgel, Pcrsonnel 
' Management, p. 229. —~ - 

11} B. *i* nurtt, Daploymont Psychology . p« 357* 
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10. In order that tha mind of the rater be restricted 

to tit© job, It may Us desireafele to omit the title of a 

characteristic but to describe it In terms of pertinent acta 
1 

on the job. 

11# Only those characteristics that cannot be measured 

by uli objective test should be subjectively evaluated on 

2 

g rating scale* 

12* Only universally understood phrases should be 

a 

US«k1. . 

13. Probably in ordinary saric, the natter of 

■".' •' - ’4 

weighting is unimportant* however, it nay bo wiso to 

assign rough weights nuere there ore significant differ- 

5,6 

oncos in the .importance of characteristics. 

14. Hatings should be nado in response to a pertinent 
7,8 

question. 

9 

18* The optimum number ot scale division!* is five* 

10* The line should be of such a length that a 

10 

stencil for scoring the rating can be easily calibrated. 


. 1] icolit, Jiothier, V.atheuson and 8pr legal, Personnel 
■ Managenent , p, 229. 

2) Ibid* p. 232. 

3) P* IU Eyraonda, Diagnosing Personality and Condu ct* 

pp. 66, 06. 

4} Ibid, p. 63 

6) B* B. Burtt, IrsDloyr-ent P ayohDlog y. pp. S63, 384. 

6) According to Tiffin and iluscer. ( nei»;hting Merit 

Heting I tens * Journal of Applied Psychology, 194E, 
V 0 i« 26, pp* 575-593) unless standard (a) scores 
are used, the items will weight themselves in a 
BOJiewhat arbitrary manner* 

7) Scott, Clothier, -iathenson and ~pri©£tsl, Personnel 

SSanageaont , p* 227* . . !iri ' 

8) J. P. Guilford, Paychometrie Methods, d. 271. 

9) Ibid. p. 263. : 

10) P. Um Bynonds, Diagnosing Personality and Conduct. p.C8 


14 * 


3,7* Tha line should be at least five inches long 
but not much longer so that it can be easily grasped os a 
whole* v .v;:;V: ”,. : ; v 

18* There should be no breaks or divisions in the 
rating line. .. 

19* Careful consideration of the descriptive phrases 

below the line la essential to the accurate use of the 

• 3. ' 

'rating scale* : 

20. Decide first on the phrases to represent the 

4 ' k,y\- ■. , .j 

extremes of a characteristic* 

21* In desoribiag characterlatios, avoid the use of 

such general terras as "very*, ■’extronely", '’average”, or 

S» ..." ■ >:,■ 

w 03t0Cll©ht w * 

22* The end phrases of a scale should not be so 

c ‘ > „■ 

extremely worded as to not be employed. 

23. Tha phrase descriptive of the neutral or average 
degree should bo in the center of the smile. 

24. If there are five, itens, the intermediate ones 
should be closer in nooning to the* center one then to the 
extremes*■ 


T) J." "i?.' Guilford. cho^etrlo ■ Methods , p. 271. 

2} Ibid. P. 271. 

3} ocott, Clothier, iia thews on ami apriegel, i'ersomicl 
Management , p* 227. ' 

4) P, M. bysoads, Diagnosing Personality and Conduct , p.05 
5} I* P. Guilford, Psychometric Methods , p, 2VS., 

6) Ibid* p. 271. 

7} P*. M. Syiaonds, £iannasing Personality and Conduct, p,65 

8} ibid. p. 56. 
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25. The favorable extremes of a scale should be 

alternated in order to do away with a tendency to check 

- ■■■ :. 1,2 

at the war$in of a page. 

26. Descriptive phrases should be set in stnall type, 

J;;. '■ 3 

and there should be plenty of white space between then. 

27. The extreme phrases should be set flush with the 
end of the line. 

28. A finer distinction should not be required ia 

rating than la scoring. If anything, the scoring unit nay 

5 :v 

be smaller than the rating unit* 

29. In scoring, o stencil which divides each line 

into several sections to which numerical values are 

(i 

assigned should ba used. 

30. The divisions of the scoring stencil need not 

be equal. They way bo made to conform to the dlstrlbu- 

7 '■ ■ ' 

tioa of ratings. , 

31* To encourage giving information not provided for 

8 

on the forms, a space should be provided for tbut purpose. 


p. lir Syiaonds. Dlornoslng Personality and Conduct, p.66 
J. P. Guilford, Psyc{-.onetric Pcthocia . p. 271. 

P. 1C. Synonds, Magnoaing Personality and Conduct ,p.66. 
J. P. Guilford, Psychometric Pet hods ." p. 271. 

Ibid. p. 272. 

Ibid. p. 272. 

Ibid. p. 272. 

Scott, Clothier, Hathevson, and Sprlegel, Personnel 
; Kanageaent , p. 232* . . 


52* 2'he rater should be ©hall©seed (on the fora) to 

illustrate tbs tyoe-of action that tie regards as typical 
1 

of the raitte* . . ;-..V 

33* Judgments auould b© based on observations of 
concrete actions so that a apace should bo provided for 

chocking *no opportunity to oissorvo** or soa© similar 

■ 2 ;' ,;vJ v ' ■■■ ■ ;:• 

©X|ia?<e 08 ion*' : -/ : ' '■■ V' : ;V v.v ;; -; : . 'V : \ 

The principles listed above will serve as a guide in 
the construction of the scale for Marino noa-coaiaisGioaed 

f \ , ;,.y-v ■■■,;' ■-■ ;■ yy—.y',,;.- _ y-;y 

officers* 


D* done Methods of Validating Hating Houles* 


R* 2# Driver lists some possible methods of estab- 
llshlng the validity of rating scales as follows: 

1* Comparison of the scale with some direct measure 
of performance. j 

. 2* Comparison with psychological tests purporting 
to measure the seme ability# H 

3* Comparison with "work samples’* (a short period of 
performance under controlled conditions*) 

4* Analysis of the distribution of results* If 
ratings tend toward the normal curve, some investigators 
believe they are noro valid# 


1) 'Scott,' 'c'lo’thior,. I’atheWflori, end Hpriegel, Personnel 

?.Uma moment . p. 227* 

2) Ibici, p. 2©2. 

3) R. 5# Driver, The Validity and Reliability of Ratings 

Personnel, ieb* 1941, pp. 105-191* 


,* 
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&*• Analytic to docarmine she presence or absence of 
the "halo effect"* Agai u some investigators believe that 
a normal distribution indicates absence of that effect and 
indicates a more valid scale* 

. 6* Follo$t~up procedures *• x*atings compared v;Itfc the 
progress of an individual in the organization* 

?• ..liEcellaneous methods; 

a* Comparison of rater’s opinions with those 
of persons considered sell informed. 

b# Comparison of ratings with recommendations 
for salary changes* 

e. Analysis of differences occurring in 
rating us a result of training raters* 

d* Analysis of the consistency of ratings 
when an individual is rated in different departments* 

e* Axarainatioa of the readiness with which a 
rater is willing to change his opinions as an indication 
of the value of the rating* 

f. Comparison of the ratings of a group of 
individuals considered outstanding in the organization with 
a group of inferior individuals. 

Most of the methods described above are of little use 
in this instance. Mo direct measure of performance will be 
available. The use of psycbologlcal testa as a criterion is 
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questionable* & groat many of them are validated with 

rating scolea as criteria* Personality tests would 

necessarily be used to a large extent, and the methods of 

validating theta are on somewhat shaky ground. The duties 

of BCD’s in the Marine Corps are too diversified to lend 

themselves readily to "work samples**. 

1 

If the opinion of Hill is allowed credence, then a 
normal distribution of ratings would not necessarily be 
expected. The use of follow-up procedures would oecra to 
be lifting one’s self by one’s bootstraps since ratings in 
the Corps should count heavily in determining the progress 
of an individual. 

Hone of the methods listed under seven above may be 
useful so general checks on a scale and will be given con¬ 
sideration. 

Ono writer suggests thet human judgments in them¬ 
selves possess a degree of validity and suggests that the 

beet method of achieving validity is in th© initial selec- 

2 

tion of the characteristics. Ono mothod is to got the 
opinions of several persons directly concerned or associ¬ 
ated with the persona to be rated as to just which charac¬ 
teristics are important. The results of a tabulation and 
analysis of these judgments is later incorporated in the 
scalo. The method will be followed in this project. 

T3 H. 17 i;lll. idrf'iciVncy 'i;a tla7 ; ^ . Personnel Journal, 1937, 

VOl. lb, PP* j50“wv2» 

2) P. U. Byraoado, Diugnoslng Personality and Conduct , p.108 
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32 * Some Met hods of Establishing the Heliahiiity of Hating 
Seales. 

t.'hlle methods of determining the validity of a 

rating scale are not very successful, reliability can be 

determined with reasonable accuracy# There era two common 

methods. One is to correlate ratings of the seme rater 

end rateos which are made at sufficient intervals so that 

the rater uill not remember his previous ratings. Tbs 

other method is to correlate the ratings of two or more 

different rater & of the same r a teen, Sl&wson coiiduded 

that two ratings by the same judge are no better than one 
1 

rating. Though this study has not been verified, it 
oasts sufficient doubt on the first method to noise the 
second one desireable ehdre there 'is a choice, A relia¬ 
bility cooeficient of about *55 is typical under good 
, 8 

conditions. However, none scales have had a reliability 
m high aa *B7 considering the agreement of the rater with 

*fc 

himself* 

F, Considerations in Instructing Haters. 

A great deal of importance should be attached to the 
instructions accompanying the rating seels. Through these 

XT’~ tuotedin s?V '"EV'Symonda, Diagnosing P erso nality and 
Conflu ct. p* 99* 

£) lbi’d’7 p. 95* 

5) IU E. Burtt, Employment Psychology , p* 3B2. 
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instructions those who huve not had training in rating 
should bo able to obtain sosao amount of specific informa¬ 
tion which will tend to increase the validity of their 
ratings. The raters* task should not ho too tedious, 
and the instructions accordingly should be concise yet 
cover the salient points; they should be clear and free 
from technical language; they must fit the particular 
scale and purpose at hand; and they must make sufficiently 
obvious the pitfalls which the rater himself may be able 
to avoid end the undesireofelc effects Kiri.cn he may help 
to lessen. 

It is. convenient to divide the problem into two 

ports: (1) a set of specific instructions pertaining to 

the mechanics of marking the scale, and {&} a set of 

general instructions concerning errors and pitfalls in 

the subjective mental process of formulating ratings. 

The formulation of the former will be delayed until 

the scale has been completed, but the considerations for 

the general instructions will bo dealt with now, end 

Inter converted into the form in which they will be used. 

It should be understood, first, that the success 

of any scale will depend largely upon the proficiency of 

the rater and that this proficiency can be improved by 
1 

training. There are many concepts of which raters need 

n "d "jd« n "i^okraas' X'otamoa Inline i on in Implode Bo tings. 
Thu Personnel Journal, vol. 18, 1940, pp.2bl>jJdvT 


be entire* Most rateru rill be aware already of Eany of 
these, but a tangible confirmation of their own thinking 
is certainly dcsircable* 

The rater should be aware of the primary objectives 
and uses of his ratings so that hia interest and beat 
effort will be aroused* He should thoroughly understand 
the importunes of his work and know that it will be 
utilised* 

The rating officer tends to biased and unfair ratings 

when judging friends, old acquaintances, or oeraorm whom 

- 1 

h© particularly likes or dislikes. Although knowledge of 

this fact cannot eliminate it, it ebauld influence the 

rater to attempt to compensate for bias and attain an 

2 

objective and impartial attitude. 

The rater must set and maintain a personal standard 
of rating* He should know, roughly, the normal distribu¬ 
tion of scores to be expected when he is rating a group 

and should attempt to distribute Ms ratings discrimlntitely 

$ 

rather than bunch them. 

Persons can be rated best after long and thorough 

personal observation by the rater, supplemented by notes 

4 

recorded during the period of observation. However, care 


Tj P* tiyimnda , Dlagndsin;.~ Personality and Conduct, p*114 
2} H» {'. Burtt, Hnploy r aen t Pgye hology , d» 39.4* 

2) Ibid, p. 391>* “ 

4) p, U, Syronds, Diagnosing Personality and Conduct , 
pp. 45-47. ™ - . ~ * • 




must be taken that marks are based upon all the observed 
behavior and not just upon isolated good or bad 
examples. Top long acquaintance will tend toward higher 

narks for persons liked and lower marks for those Sis- 

-v; -V , 1 

liked and should bo guarded against by the rater* 

-Horae raters tend to ratio too high and r.on.e too 
low. Others tend to rate all persona-near the average* 

To help counteract these tendencies, the rater should 
know about what percentage of persons rated Should fall 
within each, division of a conic, but he can be told that 
his aiarke need not necessarily fall into e normal curve 
-since he has a.-snail sample:* \' 

The rater should be aware of the ’’halo affect*, 
the tendency for the jud^ to form a general impression . 
that is favorable or otherwise and to rate the person 

f> :’• 

ti • . 

accordingly in a number of traits. Ho can best miniraizo 
this effect by rating all the rateen on u single c liar ac¬ 
tor is tic before rating any of the rata an on-any other 
character is tic. 

There is a tendency to rote certain characteristics 
about the sane regardless of the person concerned. The 
rater can help to offset this tendency by thinking 
objectively of each character is tic in terras of performance 


irm Burtt.' nTsnioyrient Psychology . p. 393. 

2) Ibid, p. 330. 

3) Hcott, Clothier, Mathewson, and Sprlegal, Personnel 

j3anager t ent , p* 224. 

4) J .TT Guilford. Poye hone trio Methods . p» 278* 




Th© best ratings will be frost those characteristics 
of which the rater is sure of his Judgment* Certainty 
can be increased by requiring the rater to support his 
rating with short descriptions of conduct. These need not 
be given weight in the scale but can be used as a sort of 
motivation for objective thinking* 

Haters find it easier to rate characteristics which 
era favorable than those which are unfavorable, lor this 

reason,, a rater might well spend store time in narking the 

£ 

unfavorable characteristies* 

for a fair and impartial rating to which corrections 
oan be applied, tha rater »wsS do the rating unaided end 

neither ask for nor accept the advice of others ia making 

•% ... . - 
■w . 

the marks* 

Finally, the rotor must allot sufficient time to do 
. 4. 

tho rating* If he understands the importance of his marks, 
he should not need coercion to take enough time* Careful 
and considered Judgments are essential to fair rating* 

Those considerations are essential* On the basis of 
then, instructions, to accompany the rating scale will be 
devised* 

1) ' J. P. duliforct, fsycltonctrlc Methods , p* £77. 

2) H* £• Burts, ittaploymsat fayoholOKy. p* 388* 

5) ?. Km- Syaonds, ' niagnoaing fersonnlity an d Conduct , p. 72 
4} II* L. Burts, Employment Psychology. p*"d07* 
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A. A Letter iiiostioncilr©. 

The first problem In actually constructing the seel© 
was to choose the characteristics to be incorporated in the 
scale. It was decided to use opinions from a sample of 
larino dorps officers* a fora letter was devised (fig.l)* 
It was written in business rather than official style since 
the project was of an unofficial character. The impression 
to be left with the recipients was taut they need answer 
only if they were sufficiently interested to do so* 

Kather than a check list of traits to be ranked, the 
letter consisted of a short explanation of the project and 
some specific directions for listing and defining charac¬ 
teristics. The purpose of framing the letter in that way 
was to avoid leading the officers to respond in a stereo¬ 
typed Kay so that their suggestions would be their own and 
not influenced by prepared lists and definitions, ids 
indicated in the figure, each addressee was requested to 
name and define the characteristics which he thought should 
be included in the scale and to indicate numerically the 
importance which he attached to each characteristic naned* 

The letter was sent to eighty-nine ilarlne officers, 
some by name and some by duties and station* Thirty-six 
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NAVAL R. 0. T. C. UNIT 
The Ohio State University 
COLUMBUS 10, OHIO 


Dear Sir: 

The Marine Corps has ordered me to Ohio State University to do 
graduate work in Personnel Administration. In connection with 
this work, I am to do research consisting of the construction of a 
rating scale (fitness report) for Marine non-commissioned officers 
of the first three pay grades. It may he similar to the present 
NCO fitness report, or it may not, depending largely on what you 
think. 

One of the first requirements for such a scale is the selection of 
items which are to he rated. The established method of doing this 
is to consult a group of persons who do the rating and combine items 
they consider essential in determining relative merit of NC0*s, 

I very much need from you, a list of characteristics or traits which 
you think should be rated in such a scale. Would you please just 
jot down on the back of this letter the items you consider impor¬ 
tant, with a short explanation of what you mean by each item? Tor 
example, one item might be leadership , a definition of which, but 
not necessarily yours, would be: ability to elicit the cooperation 
of his colleagues and subordinates, to promote morale, and to devel¬ 
op a loyal and efficient organization. Then would you indicate 
numerically the relative importance you attach to the first ten items, 
or the numerical rank of all the items if you have less than ten? 

May I assure you that your name will not be used in connection with 
this work without your express permission. A self-addressed, postage ■ 
free envelope is enclosed for your convenience, and I hope that I 
may hear from you soon. 

If you should have any additional suggestions or comments, they will 
be greatly appreciated and certainly found useful in this project. 

Thank you very much for- ycrur cooperation. 

Very truly yours. 


FIGURE 1 


0. S. BAZE 
Major, U. S. M. C 





TABLE I 

im'Lli® LENDING mi0S£LVl& TO TABULATION 

RASK HUMBEH 

Lieutenant Colonels 3 

Majors g 

Captains 10 

First Lieutenants 7 

Unascertained i 

Total 23 


TABLE II 

REPLUG KOT LENDING THEMSELVES TO TABULATION 

. RANK. NUMBER 

Lieutenant Colonels 3 ' 

Majors g 

Captains 0 

First Lieutenants 1 

Unascertained i 

13 


Total 



answers were received; of these thirty-six, twenty-three 
could be used for compilation, thirteen could not because 
no characteristics wor© listed* The sample won snail, but 
a glance at Tabic 1 will indicate that it is a fair cross- 
section of a Marine officer population* a preponderance 
of tbs junior officers reported, but this is not believed 
to be undeaireablo since their lack of seniority is com¬ 
pensated by she fact that ordinarily company officers rote 
HCO’s* It is possible that better results night hove been 
obtained through a selective process, emphasizing to a 
greater extent the knowledge and experience of senior 
officers* However, this point could not be considered 
because addresses of senior officers were not available. 

Ji* Tabulation of the Suggested Character is tics* 

when the returns from the questionsire letter were 
receded, the characteristics suggested were sorted 
according to definition * Definitions which were identical, 
or nearly so, were placed together. Thirty-one character¬ 
istics were isolated fairly well in this ?my* (Table 3). 

The problem then was to determine which of these 
traits wore considered sufficiently important to be included 
in the scale* An arbitrary method was used. The traits 
were tabulated as indicated in Table 3. The horizontal 

columns were numbered from one to thirteen (fairteen being 


characteristic 


BAKK 


1 2 3 4 5 6 7 8 9 10 11 12 


1. 

Attention to 

5 

0 

1 

0 

3 

0 


Duty 







2. 

Attitude 







3. 

Ability 

1 
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Cornaon Sens© 


1 

1 

6 

3 

1 

3. 

Cooperation 

1 

1 

2 

1 

3 

2 

6. 

Dependability 



1 

X 



7. 

Efficiency 

1 






8. 

Force 

1 

1 


X 

1 

2 

9 « 

Handling Troops 





1 


10. 

Initiative 

2 

3 

2 

2 

1 

2 


0 

1 


11 . 

12 . 
13. 
14 . 

15. 

16. 

17. 

18. 

19. 

20 . 
21 . 
22 . 

23. 

24. 

25. 

26. 

27. 

28. 

29. 

20 . 

31. 


Ability 
Integrity 
Intelligence 
Knowledge of Job 
Leadership 
Loyalty Cl) 
Loyalty (2) 
Military liearlng 
Morals 
Obedience 
Past Record 
Perseverance 
Personal 
Appearance 
Physieal Fitness 
Presence of Mind 
Proficiency in 
Bank 

Resourcefulness 

Sense of 

Responsibility 

Sobriety 

Progressiveness 
Open-Mindedness 


5 

3 

1 

1 

1 

1 


1 

1 

3 


1 

1 

3 

3 

1 


2 

1 


1 

4 


1 

1 

1 

2 


1 

1 

2 


0 0 


2 

2 


1 

1 

1 

2 


1 

1 


3 

1 

1 

1 

1 


3 


1 

1 111 1 

2 3 4 4 1 

3 1 112 
3 1 112 


1 

2 


1 

4 


1 

1 


TABLE 3 

Tabulation of Characteristics suggested by title and frequency 
with which a given rank was assigned. 


the largest number of characteristics submitted by any one 
offioer)* Then the amber of tines a characteristic ®ea 
assigned a particular rank ®ea entered in the rows* 

The relative importance of the characteristics was 
determined as follows* The one receiving the largest number 
of first rankings was deemed most important} the one 
receiving the largest number of first and second rankings 
(not counting the first characteristic) was deemed next in 
importance; the one receiving the largest number of firsts, 
seconds, and thirds (not counting the first two character¬ 
istics) ©as deemed of third importance; and so on* As indi¬ 
cated in Table 4, this procedure was halted after determining 
the relative importance of thirteen characteristics* The 
remaining eighteen were arbitrarily eliminated since each 
was suggested a maxlmuof of three times and several of them 
only once. Another characteristic was eliminated froa the 
list of thirteen* This was the last one,"persistence”* 

The reason was two-foldi (1) persistence should have been 
combined originally with "attention to duty" since the 
definitions were extremely similar, and (2) it was discovered 
at this point that characteristics one through nine and 
eleven through thirteen corresponded to the characteristics 
listed in item nine of the 2IC0 fitness report now in use. 

Item ten of Table 4 corresponded to the several characteris¬ 
tics In item eight of the NCO fitness report now used. A 







TABLE 4 






fairly obvious conclusion could be drawn: that the charac¬ 
teristics in iters nine of the present KCQ fitness report 
were considered in the main satisfactory by the Marine 
officers reporting. 

> The characteristics to be incorporated in the scale, 

then, were to be: 

1. Leadership 
2* Attention to duty 
3. Loyalty 
4* Intelligence 

5. Initiative 

6. Common sense 
7* Cooperation 

8* Personal appearance 
9. Force 

10* Knowledge of job 
11. Physical fitnoss 
12* Presence of mind 

It should be borne in mind that, though the charac¬ 
teristics are listed by title for convenience, the impor¬ 
tant factor is the definitions behind them, regardless of 
what the title might be* 

Doubtless there is overlap between the various 
characteristics. For example, one could argue reasonably 
that leadership is composed of any or all of the remaining 
characteristics* However, names for human characteristics 
seem liiaited only by the restraint and vocabulary of 
writers on the subject* For those characteristics termed 
"social 1 ’ in particular, no rigid categories ere developed 
and no certain method has been devised for isolating 
cfaaracteriatics which are completely independent. There- 




fore, la the practical situation, it would oec-a more 
important to consider th© raters* desires in the interest 
of gaining their cooperation. It appears to the writer 
that a primary consideration has been fulfilled! the 

characteristics included in the scale are those considered 

1 

sost important by the persons who do the rating* v 

C. Definition of the Characteristics and choice of 
Descriptive Phrases. 

A good way to formulate definitions is to choose 
several definitions for each characteristic and submit 
them to a large number of judges for selection* for the 
descriptive phrases, choose a great many descriptive 
phrases for each trait* Then submit them to judges to 
arrange in rank order according to their strength from 
least to most. The average runic of each descriptive 
phrase then is its scale value end phrases equal units 
apart can be chosen for inclusion in the rating scale* 
However, the method just described requires more 
staff and time than were available for this work so that 
a simpler method still was chosen. The method to be 
described lacks objectivity by comparison, but it is 

believed to bo an adequate ono, adding some validity to 

■ ■■■■■" v £ 

the construction of the scale. Dysrmds states that the 

li '"poo C , L..c.h rile. Occupational Information , p* 1E6, 

for a brief discussion of thiu point* 

2} ii. i*. Bur it, Hmoloyr.ont Psj/oholoi-y . p* 573. 
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erx*or» due to the unreliability of rating are greater than 
the errors due to carelessness of scaling, so that the 

. -v-. 1 

latter can, for practical purposes, ho disregarded. 

Characteristics would bo tentatively defined and 
descriptive phrases tentatively selected. Then they would 
be attacked by a conference frosa four angles: 

1. Are the definitions appropriate and objective? 

2. iki the descriptive phrasea fit the characteristic? 

3. Are the descriptive phrases scaled correctly 
within each group? 

4. Are the strengths of the descriptive phrase 
groups equal to each other? 

Accordingly, in the light of the definitions 

suggested by I!arino officers, -the characteristics were 

tentatively defined and put in the form of questions# 

Five descriptive phrases wore then tentatively selected 

for each characteristic. Several industrial and service 

scales wore revisited for ideas on phraseology, and Hoget’s 

. £ 

thesaurus and Colonel Munson’s book on leadership were 
consulted for the same purpose. The selected list follows 
{first draft): 












Leadership: Las this HOD been sucessful in directing, 
controlling and influencing others, while maintaining 
high morale? 

a* Inspiring, taen will follow him anywhere* 

b» Handles men well; commands respect. 

o* Gets the job done. 

U* Men hove little confidence in him* 

e* Continued friction with subordinates. 

Attention to duty: Has this KCO applied himself to the 

duties of his job, day in and day out? 

a. Lnergetleally applies himself; is not 
afraid of doing too much. 

b* Always on the job; feels his responsibility 

c. Poes the work assigned to him. 

d* Heeds occassional prodding. 

e. Lasy; needs constant urging. 

Loyalty: Has this KCO rendered willing and faithful 

service at all times to hi© superiors, his subordinates 

and the unit? 

a. Complete, unfailing, energetic support. 

b. Actively supports his man; his superiors 
and bis unit; a booster. 

c. Usually defends his men, his superiors 
and hie unit* 

d. Loosely criticlues his men, his superiors 
and his unit. 

e. Lever mioses a chance to knock, growl or 
gripe. 
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4# Intelligence: Mas this IJCO followed instructions 

easily, learned readily, and caught on quickly to new 
situations? 

a. Exceptionally quick. 

b. Learns with ease. 

c. Ordinary. 

d. Slow to learn. 

e. Dull. 

S. Initiative: Has this HCO acted on his own responsi¬ 
bility in the absence of orders? 

a. Looks ahead; ready for proper action 
at right time. 

b* quickly sees things he can do and gets 
them underway. 

c. Does most things right without being told. 
dU Lees things to do but asks first, 
e. Doesn’t see things to do; gives up easily* 

3. Common sense: has this !iCQ considei’ed all sides of 
problems presented to him and arrived quickly and 
certainly at the right.solution?.. 

a* Cones up immediately with the right answer, 
b* Clear, quick thinker; usually right, 
e. More often right than wrong, 
d* Has trouble finding the right solutions, 
e. Seldom draws the right conclusions. 

7. Cooperation: Has this LCO bean successful in dealing 
with people? has he been helpful and considerate in 
manner and act to his superiors, subordinates, fellow 


HQO * a and civilians? 

a. always helpful' and considerate to everyone* 

b* Usually has the feeling and interest of 
others in mind* 

c. Conforms; pleasant to deal with* 
d* Awkward in dealing with others* 
e* Antagonizing* 

3* Personal appearance: lias this !K;0 fnvoi*ably Impressed 
others by his physique, bearing end manner? 
a* Commanding; excites admiration, 
b* noticeable; definitely an asset* 
c* Impresses others favorably* 

d. Impresses others negatively, 
e# floppy* 

9* Force: has this SCO carried out his objectives with; 
persiatance and firmness? 

a* Dynamic; commands obedience. 

b. Pursues his goals with vigor and confidence 
o* atoera the middle course* 

d. Botiring; laei:a confidence. • 
e* Gives up quickly* 

10* Knowledge of job: fins this KCO demonstrated mastery 
of the technical knowledge necessary in his job? 
a* Knows all there is to know* 
b* Mas thorough working knowledge* 
c* Knows enough for satisfactory performance* 
d. Gets by with difficulty* 
e* Doesn’t know enough to perform efficiently* 
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11. stamina: Baa this SC0 demonstrated physical stamina and 
endurance under hardship, adversity or discourager sent? 

a* Always ready for more; nothing gets him down* 

b* Bard to get him down* 

c. Physically fit* 

d* Tires easily; lacks stamina* 

e* Always tired; can’t take it. 

12* Presence of mind: lias this HCO shown that he can function 
promptly and effectively under pressure? 
a* Super effective* 
b* More clearheaded than ever, 
c* Heliable end normal* 
d* Less effective than usual, 
e* Loses his head* 

The list was then submitted to a conference comprised of: 

1 Captain, U.S.H* 

1 Commander, U.A.Ii, 

1 Lt. Colonel, y.C.A.Hcserve, (Professor of Politi¬ 

cal science). 

2 Lt* Commanders, U.B.IL* 

1 Lieutenant (A.G*j U.S.K. 

The faot this conference was comprised predominantly of 
persons in, the Baval Service should not be important since the 
Judgments were of a general rather than a technical nature, 
and all have had experience in the armed services. 

* separate conference was held with a Marine Captain and 
a Staff Sergeant, U. S* Marins Corps. 
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Extensive modifications ®ero raade. The principal ones 
woroi 

1. Loyalty wa3 divided into two definitions, one for 
loyalty to superiors and one for loyalty to subordinates, 
since the tentative definition was considered "double- 
barrelled*. 

2* In two oases the number of descriptive phrases was 
reduced to four equally spaced phrases because the degree of 
possession of those particular characteristics seemed to fall 
more logically into such a grouping. 

3. Xu one case, the number of descriptive phrases was 
reduced to four but the spacing was left intact. In this ’ 
euoe, the oonferces agreed that a blank was better than any 
descriptive phrase suggested. 

4. In one case, the number of descriptive phrases was 
reduced to throe. The argument hers was that three degrees 
were as nany as could be differentiated* 

The revised definitions and phrases are listed below; 

1. lias this KCO been successful in obtaining the 

spirited, cheerful, and willing obedience and cooper¬ 
ation of hin men? 

a. Men will follow him anywhere. 

b. Handles men well. 

c. Usually gets cooperation of man. 

d* Men have little confidence in him. 

e. Continual friction with subordinates. 



iiaa this NCO applied himself to the duties of his Job, 
day in and day out? 

a. Never spares himself, 

b# Does more than expected of hi®, 
e* Does the work Designed to him, 
d, Deeds occassional prodding* 

©* Lazy; needs constant urging. 

Has this i?CO been loyal at all times to ilia superiors? 
a* Complete, unfailing, energetic support, 

b. Actively supports bis superiors. 

Cm Usually stands up for superiors, 

d. Carelessly criticizes superiors* 

e* Continually gripes about superiors, 
iias this JvCO bean loyal at all times to his subordinates? 
a* Complete, unfailing, energetic support* 
b* Actively supports his men, 
o. Usually stands up for hie men. 
d* Carelessly criticizes bis men, 

e. Never says a good word about his men. 
lias this l?co followed instructions accurately, learned 
readily, and adapted himself quickly to situations? 

a. Exceptionally quick, 

b* Catches on easily, . 

c. Ordinary* 
d* Slow to catch on* 

Cm . 'Dull*- 


Has this JIGO performed effectively In the absence of 
specific orders? 

a. Prompt in taking appropriate action* 
b* Docs most things right without being told. 

c. j^sks before taking action* 

d. Waits to be told. 

Has this HGO picked the right solution to problems con¬ 
fronting him? 

a* Cones up quickly with the right answer* 
b* Usually has good answer, 
c* iiore often right than wrong. 

d. Has trouble finding a good answer. 

e. Weldon right. 

lias this HCO worked in harmony with people in the organ¬ 
ization? 

a. Unusually helpful and considerate. 

b. Pleasant to deal with, 
o. Conforms• 

d. Irritates, 
a* Antagonizes. 

Has this UC0 favorably Impressed others by his military 
appearance? 

a. Inspires admiration. 

b. Attracts attention. 

c. Unimpressive, 
d* Uloppy. 

Has this HCQ shown drive in carrying out his duties? 


a* Dynamic• 

.. b. Vigorous. 
c* Active. 

; d. Bleak* : 

e» Gives up easily* 

II* Has this uco demonstrated mastery of the technical 
knowledge necessary in his job? 

a. Has complete knowledge. 

b. Yiell grounded. 

c* Knows enough for satisfactory performance* 

.':;.-4v ' Gets,by with difficulty# 
yV;.:,; e* Insufficient knowledge* 

12. Has this !?co shown physical endurance under difficult 
conditions? 

■;>7:xvV^ for more# 

b* Hard to got bin down, 
c# Physically fit. 
d* Urea easily. 

©. Can’t take it* 

13. lias this HCO shown that ho can keep his head during on 
emergency? 

a. More clearheaded than usual* 
b* Reliable. 

'y o* Loses his 'head. 

D. Weighting the Xtens in the Leal©. 

Attention was turned nest to weighting the various charac 
terietics* It would have been feasible to determine weights 
from the data of fable 3, but the persons awarding ranks at 





that stag© of the project had not soon the selected Hat of 

characteristics as a whole and this could make on appreciable 

change in their perspective* It seemed safer to submit the 

completed list and definitions for a new sot of judgments* 

The sc hem© selected was to have judges distribute one thousand 

points among the items of the scale, allotting points to each 

characteristic according to the judges* opinion of its relative 
1 

Importance* It was possible to obtain ten qualified judges: 

1 Commander, U.B.M, 

G i»t* Coxonels, T7»n>*n* 

1 Major, Umti.LU C• 

1 Captain, U.8.M.C. 

1 Staff Sergeant, TJ.B.M.G. 

The combined point totals for each Item ore shown In 
Table 5. 

As previously noted, the problem of weighting is very 

controversial* But tbs points allotted to one characteristic 

were so much greater in number than the points allotted to * 

the others that a x*ough tentative weight was assigned: 

Leadership Z 
All others 1 

It was not believed dosir^able to isafte a finer distinc¬ 
tion. The value of weighting items which arc not to be 
converted to standard scores (as will be noted later) is 
doubtful, since the variability of the various distributions 
will alter the assigned weights* Ffrf/if-t.'‘/ t .Y)f£iCrtiiTS WntiF. Pfr'tinit) 


1 


as suggested by p. LymanCs, 
and Conduct , p* 85. 




COmii&D P0I2I? TOTALS} ' mi pmuoilii kack 
•pOiMlS' i^O^G THE CUABACTiOULfieS 


DILTRI3LTIEG 10C0 
UGTSD B£IX)Vfi 


Characteristic 


Points 


1. Loadership 

2* Attention to duty : 

3* Loyalty (up) 

4• Loyalty ( do wn} ' 

5. Intellicence 
6* Initiative -: ■' 

7* CoEEaon sense/ -sp;;; 
8* Cooperation 
9* Personal appearance 

10. Porce 

11. Knowledge of Job 

12. Stamina 

13. Presence of mind 


. 1480 
820 
■a 900 
910 
, 740 
600 
630 
, 660 
500 
670 
780 
590 
060 

10,000 




TABLE 




i is*' The I'ora of the Kctlng «heet. . 

The fora of the rating sheets Involved consideration 
of the following principles stated in Chapter IX? . • 

1* ; It : was to^ be a scale adapted to ratine, single 
traits at a tine. £aob sheet therefore needed to be iden¬ 
tified ® 1th an ‘SCO’s -isaee and-y.rarik, and the sheets for each 
of the various characteristics needed Identifying mashers* 

/.v, space for the lost date of the reporting period was con- 
elder a A necessary in order to avoid confusion. 

2. The seal© line needed to b© five inches long in 
order to be easy to visualise* .• "7 

3* u blank would be provided for **no opportunity to •• 

^observe”- 7 7’; T'7:7 : 

4* Blanks would be provided on each oheet for speci¬ 
fic illustrations of performance in tho rated charactor- 
: iotie*77: : } 

One rule wan consciously violated in the fora: The 
oxtrene descriptive phrases were hot ssade flush with the 
ends of the lines* They were centered on the line ends 
so that half the phrase extended beyond the line* This 
procedure was followed because it was believed that most 

1} It stay b<muTt f ron an administrative standpoint, 
single efcoeta would bo impracticable. if so, the 
characteristics could all be placed on ono page and 
the extreme phrases alternated to help compensate 
for halo. The latter rjethod has demonstrated its 
practicability; however, it is believed that using 
single sheets is better fron a scientific standpoint 
and not too impractical to be used. 






raters would infer that the exact point on a line repre¬ 
sented by' the intermediate phrases would bs the center of 
these phrases* To be consistent themj, the extreme phrases 
would nccossurily be centered on the ends of a lias. 

Appendix 1 contains samples of the finished rating 
sheet for each characteristic* 

F* Formulation or lnstructiona to Accompany the Eating 

Motile* . ■ y.'VyV'W -yt V'^yV: Vy ; 'v : %y.. 'VV.VV.t;Vy ■ ■■- r 

Gtoncrol instructions for raters were written, based 
on the considerations stated in Chapter IX-*.,VV V 
11; was'believed deeireablo tos .lv. 

:: iV '14 Hestrict the instructions to those directly 
concerning the ..persons performing the rating* ... 

. : y ; 8* : •yPresent tbeta ns positively, personally end 
readably ae' possible*.-.;-' VMVV/ VyVy Vy 

$• Present then as a boaia for further thought 
on the part of.'- the rater* ; .W.VVyy.. .; ; V'' vy'.y y ;VV-V; 

Specific instructions for the mechanical sjarLing of 
the scale were also written, and both general and specific 
instructions combined into a single set. The completed 
ins true ti one are ill us ti* a ted.' 'iii’Appondlx ji, .yy y ; y'Vt 

C#. Testing the E ©liability of the mcoIq* 

The rating scale was airaeographed arid cut into sheets. 
Each shoot contained only one characteristic and. was to be 


f.-.. • ■ ; : -y.. ;.v , V 48 

’ 'i. '' ’ • .,./•/* »* . ■ ' t ' ’ 

‘ - * . > .* • ’ ’* . . ' .. ■ t ’ ’ • - • V - •• , • ■ 

used for only one rate© {sec Appendix «3}* A copy of the 
instructions and sufficient force .to rate seven Jrco’s were 
given to two officers* a Uurlno Uaptnin and a 8a vy Lieute¬ 
nant (Senior Orade}* The officers read the instructions 
and then rated a group of seven ratees well known to both 
of thorn* Vho rates group consisted of on© Staff iicrgeant, 

V* r>. IJarlno Corps and six ii&vy Petty Officers corresponding 
in rating.to the rank of .Marine KCO*» of the first tbroo 
pay grades* ^. •; y,.'!■ /y .• •• yV■y y:-W ' 

*.v: ; This group of ratees was the largest that 

^ obtained! at the writer’s station, end It Is unfortunate y'V-v 
■, that there' was not ftu'all i^arine ''group. 

''yy, 1 -/- The 'forras'were; adored with:a ruler .mrked^;iii.vteatiitt of 
an inch, and for convenience the ccores were recorded with " 
the decimal piece omitted. Tabled 6 and 7 contain thd 
tabulated scores for the group as rated by the two raters* :;: 
Cone scores sere narked 8 . for "no opportunity to observe*. 
Correction was nude for the items not observed by dividing 
the total score by the number of characteristics observed 
and multiplying this figure by thirteen {'the total number 
of characteristics in the scale}# 

Tiis corrected total scores of the two raters were then 
>v ;;;v- y v--O , v ., y i 

correlated using the "*froduct-iaoracat" correlation forKtule* 

• XI "7© ter s’ 'and Van Voorhic*, statistical Trooedures and Their 
ifothonatioal Berea , p. 97* 
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^mVLkTlQH OF SC0JIE6 




FIH1 


>T 



Characteristic 


wco 

1 

z 

e? 

a 

4 

5 

6 

7 

8 

I 

14 

23 

m 

If 

25 

1 

26 

12 

2 

49 

40 

39 

25 

37 

15 

39 

49 

3 

27 

2? 

27 

24 

39 

35 

26 

33 

4 

27 

23 

26 

25 

25 

18 

25 

26 

5 

27 

29 

29 

25 

25 

20 

24 

26 

3 

38' • 

40 

39 

25 

59 

15 

41 

49 

7 

46 

39 

38 - 

25 

25 

15 

39 

49 








Corrected 

j*CQ 

P 

10 

11 

12 

13 

Total 

Total 


1 

18 

15 

38 

27 


252 

274 


2 

32 

29 

37 

39 

25 

454 

4S4 


3 

X9 

27 

37 

ii 

£4 

350 

379 


4 

SO 

28 

25 

H 

'll 

273 ' 

323 


5 

18 

27 

«iv 

H 

H 

275 

325 


6 

35 

39 

25 

25 

if 

410 

445 


7 

34 

40 

SO 

47 

29 

464 

464 



table o 




TATJ'DtATIOK OF SCCffiSa OF SSCOHJO lU'XEH. 


Characteristic 


HCO 

1 

2 

3 


5 

0 

7 

__8 

1 

20 

19 

20 

20 

36 

■ 29 

35 

18 

2 

39 

30 

19 

54 

S7 

49 

39 

49 

3 

29 

26 

24 

N 

32 

19 

If 

37 

4 

16 

33 

30 

H 

17 

36 

18 

30 

5 

27 

26 

29 

H 

21 

2 

23 

31 

6 

32 

38 

37 

H 

' 43 

49 

35 

46 

7 

37 

33 

20 

II 

57 

N 

31 

36 


HCO 

9 

10 

11 

12 

13 

Total 

Corrected 

Total 

1 

29 

23 

39 

n 

21 

309 

335 

2 

44 

39 

41 

31 

15 

460 

466 

3 

27 

29 

25 

II 

ir ’ 

248 

358 

4 

26 

22 

33 

14 

27 

302 • 

325 

5 

35 

26 

19 

32 

25 

295 

321 

6 

29 

m 

11 

37 

27 

419 

455 

7 

36 

27 

37 

34 

tl 

329 

426 
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A correlation cooefioieat of *92 was the result* The 
calculations are illuc tratod in Table 8* 

JPisher*s forraula for the "noat likely population e^uiva- 

1 : •; ■ l r\- -v ■ , • : . . 

lent of cn "r” was then applied and *91 obtained with the 

coeficient carried to two decimals (see Figure 2). 

The probable accuracy of this cocficient was determined 
by computing "Student*s "tj* for the reliability of an "r” 
■.'when estimated fran the sampleThe t obtained, was 4*91':: 
(sea Figure 3) Thie t was coaparcd with Table XLV of Peters 
and Van Voorhie*.- Statistical Procedures and T heir Huthemiti - 
ca l Bases * ;= Interpolation f^ba’.;thc : table. Indicated that .14$> 
is the probability of obtaining an r bf *91 by chanc© with 
the sample used; or odds of about 7C0 to 1. Fisher would 
- ter m. the reliability ‘♦highly alsnificeut*. 

From the figures above, om would assume that the scale 
possessed a markedly high degree of reliability* However, 
it seems safe, beouuse of the smil size of the sample, to 
say only that the scale possesses sons reliability* It is 
doubtful that u sample of loss than ten persons would reveal 
the reliability of this scale with any accuracy* For. this 


XT Fcters and Van Voorhis. iFtatlatloai Procedures and Their 
■V' Pathenuti ca i pause s. p • 133» 

2) Ibid., p. 104. 

3} Ibid., p. 176. 

4} Ibid., p« 13b. 




W- »><* 

.TI0H 01? 

fj ?. *t*r sar* 

**■**> A JU l \ *k$. 

i/L -V.il fc-jna^ * ■ 



3100 

•w 

A 

V 

■A 

X 

y 

Y> 

*w 

X 

E 

y 

xy 

1 

27.4 

33*3 

-10.7 

A* ft 

•* 4 « + 5f 

114.49 

24.01 

32*43 

s» 

4# 

45*4 

4s*e 

^ 7.3 

j*8.2 

53.29 

67.24 

59*66 

3 

37.9 

35.6 

- .2 

-2.6 

.04 

60.76 

.52 

4 

32.3 

32.5 

- 5.8 

-5.9 

53*64 

54.61 

34.22 

5 

32*5 

32.1 

- 5.6 

-6.3 

31*56 

89*69 

83*28 

6 

44*5 

43.5 

/ 6.4 

/7*1 

40.96 

50*41 

45*44 

7 

46.4 

42*5 

/ 8.3 

•/4.2 

66.89 

1? *64 

34*66 

i?a^- y 

A ■*** '*-L* 

286.4 

268*6 

» 

-., -' i ■ ’ 

342*67 

£40*56 

282*61 


Umn of X S '33*1- Standard twuuoa of 1..- 6*95 

Mean of X - 56*4 Standard Deviation of Y » 5*8? 

,/ . - 

r * S'aty a? 262*61 * *92 

IT ox c/y 264*78 


TABLE 8 


Moist likely value of r 


% 


Bar - r{l-r ) 

“wn 


►9a - «9Stl—»B464) 


* .92 - • 010^60 

* .91 


l-5r 

•CT15~XT 


T - 3.-4.23a 

.. M 


PXGUHI. 2 
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'■Estimate of probability of obtaining by cfcanae aa 
r of the size obtolaed 


t » 




i ta-a) 


5 X .8391 

\i i - .aaai 


* 4* 


91 
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reason, ahy further statistical'tirielyais was reserved 
until such time as a lar^ur sample could he obtained. 







■Bom METHODS 


OF 'CQW$m'h$W& FOH 

'■ V' V 


VAJilATIO*®- III 


,'s 


BATING' 


It can safely be said that ho method of compensating 
for variations in raters* standards can be completely 
satisfactory, bet that some method is essential to get 


ratings on o, comparable basis, Behenes varying from the ' 
very simple to tho extraordinarily'compter have been devised 
Borne of the simpler ones are adequate, luckily, for the more 
complex aud long statistical processes are not practical \ 

v to correct a #caie used to rate © large nui»iber of persons, ; 

■. • ■' * ,V-1 •• "• - 8 

Borne elaborate systems, are suggested by Guilford and Bent. 

They have la oos&on the unfortunate -chare©tei*iptic of being 


Impractical for large groups* Chosen for consideration in 
connection eith this rating scale are three* less .complicated 

■ methods^:'-y - c' ;; ';>>y 

1. Fooled ratings ' 

a*..-;-:Btandar.d. scores ..'' •/; 

;;“"Fy;v '3*'c,letter grades ;• m,F. :: 

A, The Method of Fooled Bating©. , v"* 

’’The objection that ratings are subject to many constant 


errors is act by proof to the contrary that pooled ratings 

3 ■ ■ 

somehow eliminate the force of.these errors." 


• U J. d. Guilford. ■ Psychometric Methods, p, 872-374*' 

8) R. £• Bent, Various - Too t.nlcnes of Combining Bat Inga ,; 

Journal or nOuca t io rlcTrsyc ho fogy, “hi, pp~ ob-7G* 
3} J, .P, Guilford, i-*sy c homo trie lie tho do . p* .880# 







The pooling ot rating amply ss&wia having aorc than 
cnc ra.tox* x*utb each raioe. 2h»' 'difficulty"is la sotting a 
Sufficient number of raters who know tke ; -r&teb well enough 
to give a fair rating* Cyrjonds says that the pooled 
judgments of five to ten rutavn are necessary to get 

;,•„ :•■■' r ; —• <1 ■. rl •■,. f .-• ?'" ■■ ’- : ■» v ‘ ^ ■ 1 v;.: 

sufficient ':v<\ ■•■•',.; v .. 

Others have drawn the conclusion that three or four 
ratings averaged till locate the person, in. the scale with 
sufficient accuracy*; Arithmetic averages of th© ratings 
would then provide a,fair epaposito score ori : ©ach accession 
a rating is i^de* ,Aronson noted that iti t'bo : d?V'S* Civil 
Service even, triree qualified raters usually cannot bo 
found. That pay well bo the case in tho I&rin© Corps* 

'A more- sitoraentoua ob jeotion to the 'method. 
opinions of the juore senior officers night be reflected in 
their Juniors** iiemevor, the tendency could probably be 
offset by not allowing any one rater to. see the • marks node 
by another, or by having Junior officers rate first* 

D* ThefcTothod of Standard Scores. 

A standard score is the deviation of &. particular score 
from the neon of a distribution of scores divided by the 


TJ 1 H* r ''ayxa'oods', rr ^'iagndsTng Personality and Conduct, p. 96 

Si ■ iioott, Clothier, Authuaeoa. ana Apr is gel. - Personnel 
. Hanogoncnt , p* £33 « 

3} : A. ii« jiTonaon. Service Hating .Plana . Public Personnel 
BevleW, 1941, 1, U, pp. iTJU-bOb. 






standard deviation or the distribution. The scares are 

thus reduced to coition units and cun be compared with one 

■wy■: %' v- >v '* .•.,•> i-. 

- - { ^ )!»■ • ♦. t- •_ , r ' V • • .... y ••._ ,• • a •• j 

another. .*.‘;"% :-. t ■;< •• ; ,*• ; 

To compute standard scores, continuous records would 
be kept of a rating officer’s scores for all th© 3lviO r s he 
might .mark. /The feean ©ad standard deviation for a jarti-* 
cular rating officer would be computed. -The deviations 
from th© mean for each KCQf rated would i>© found and divided 
by the standard deviation to compute his standard score# 

All standard scores tend-to rungs betweeu plus end 
minus throe. To get the so ores on a wox-e familiar basis, 
they could be multiplied by ten uad seventy added to each# 
Then the rang® would b© between plus 40 and 100.. 

Though th© 'statistical procediirua for computing the 
standard scores of one distribution is not exceedingly 
laborious, When rsultlpliod by a thousand or more, the 
mechanics of computing them, soy t?#ic» yearly, would 
necessitate © large group of computers and all skilled at 
operating o Calculator, not to mention the acquisition of 
th©' calculating machines. In ctddition, the Method was i ; 
intended to correct 'rsore-'.forkni.teats-,/''and its aecuruoy is 
aoiacwbat wasted in correcting scores derived from opinions# 

0* ! - : -' ; TbS'-iJae\of•• letter.'..tSTades#' ,y.''.y';y 

a simpler and more convenient method described by Burtt 

XT Inters"“aricPvati ‘#o'ofliTa T T >>tut'iatical Methods and Their 
Matheoatic nl iJnacn , p* &o# 
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8Goss to the writer to be adequate: . 

*a sc homo that baa oomt'iaes been used consists of 
taking a considerable number, perhgps 50, of ratings made 
by a given Individual*■ arraaging tkeai in order from best 
to worst, and calling the boat 10 percent a, the next BO 
percent B,. the middle 40 percent U, the next 20 percent 
B and the-- lowest 10-:paroe&t Thus,: afterr alii\,«hether' 

the rater takes & high or low standard, those whom be puts 
relatively high will receive an a rating, indicating 
desiroabiu possession of tho trait, and those with rels- 

: •' ,••• ..v ' .. '' . {. ,. o.;; =/=;, 

tively low ratings will receive a grade oMi." 

The labor in applying this sobeau would be considera¬ 
bly reduced from that of the standard scores method. One 
difficulty is that'the scheme could not bo applied until 
a rater had rated the prescribed number of BCO’sj another 
is that the eyebom might be unfair when the tiQQ's rated by 
a particular officer really wore within a very narrow rung® 
of proficiency. But these, difficulties -©re" lik©wis6:.:/f^Q, 
encountered uuiagaterider d .scores*.. m f 


The problem finally resolves itself into whether any 
ayatea.- of)- eorroction should be tieod• r In tiia opinion of the 
writer *'•■ the advdxitages of using some system unquestionably 

• V.7"> •' 


outweigh the disadventugea, and the most expedient system 


of ; correcting ratings of 1100 *a in through use of the 


latter-grade system. 



. CKAPTSB V. 


A SC til 


? 0R TKH. tki. .01' 


Tin. iiCALk. 


The construction of the scale being complete and systems 
for correcting rtitings having been consldei-ed, the problem 
regains of -putting these things Into a workable arrangenGnt. 
How should the rating scale be incorporated into the total 
fitness report, and what schone should be used to put rating 
corrections into effect? 


A. Incorporating the i>oale into the Total Fitness Beport* 
To incorporate the scale into the fitness report 9?ouid 
necessitate two Changes in the report. First, it cub six 


' V -. 


■ V ;r. 


and seven, which are instructions to. rotors, must be 
replaced by the set of instructions applicable to the new 
soala. Them, the new scale must bo substituted far items 
eight and nine, which contain the;aoaio used at present* 
The form of the acaio here constructed dicta tee that 
it bo separate frora the rest of the report* A solution la 


to print the fitness report {lose the rating scale) on an 
envelope, also 8& by 11 inches. The rating sheets could be 
printed on thirteen separate pads, one characteristic to a 
pad, with perforations between the rating sheets so that 
each could be removed singly. 

Then after rating characteristics one at a time, the 
rater could sort the rating sheets into the envelopes 



according to HOC*s rated and forward tfceai. 

The ratwra* iaatructibna wouId also be separate from 
the report forms, but distributed along with and in pro¬ 
portion to the report fonts and rating shoots. 



B# Correcting Variations between Butera. 

Two copies of the report would be forwarded to Head¬ 
quarters,'- '• One oo'p^i;^rbuid •'b^.'filed^ 1st., thous’dpdrting' ' 
officer's file; the other copy would be filed In the KOO’s 
file. As the reports are placed in the officer’s file t 
they could be numbered* The file clerk would in that way 
be notified automatically when enough reports were in an 
officer’s file so that corrections to his reports could be 
made, This number could be fifty or less. The exact 
nuabor could be determined arbitrarily by observation of a 
sample of all officers’ reports to see whether range limits 
of rating scores sere becoming firm. 

Then, a range for each reporting officer could be 
established between his high and low scores. The Upper 
10^ of his range could be given a grade A, the next kQfc 
3, the next 40>*. Cj'the next 30£' p 9 ■ and ! the l&st'10,4 E. 

Grades would then be transferred to tbsi&O’s files, 
Ganges could bo ohacked periodically as detertained from 
experience* •. 

The rsotbod of ranges is recommended in preference to 
arranging the sooroa in order frora best to worst as 
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described in Chapter IV, C* because it la quicker and 
easier.wr.ea largo-humbere ot reports ore dealt with.;- 
No doubt many minor problems would arise in connec¬ 
tion v?iih the administration or this action*, but there 
is no apparent reason shy they could not be easily solved 
as they 'arise, v-V ^:.v 


60 . 

GllvH&.K VI- 
COflCLUSIQI©. 

It is believed that the scale may be used effectively 
In its present form* however, cortain improvements should 
be made in the scale after it has been used by a larger 
number of raters to rate a larger number of HCO’s* Among 
these improvements are: 

A. The reliability of the scale should be checked 
on.a larger sample* '■ 

3. Scores on single characteristics could be inter- 
correlated with (1| total scores and (2) independent 
judgments of an JiCG’a general efficiency with a view to 
determining whether a lessor number of characteristics 
would yield a scox*e close to that ot the thirteen now 
Incorporated in the scale* ouch a procedure would probably 
result in future revision to a shorter and therefore 
simpler scale. It would also contribute to its validity 
by eliminating the less discriminatory characteristics* 

C* ..loro logical weights for the remaining character¬ 
istics might ba determined arbitrarily on the basis of 
the intercorrelations* 

I). Improvements in the definitions and descriptive 
phrases no doubt can be rede and should be from time to 
time. There is no reason for the scale to become static* 
One of the advantages of the graphic scale Is that it 
lends itself to change with a minimum of disruption of 




administration# 

ii# 1-bought slight bo given to the possibility of 
malting scoring stencils calibrated so that there would be 
a stencil to fit (approximately) any rater’s distribution 
of marks. Then corrected scores, or even letter grades, 
could be read directly from the stencil as the scores are 
measured. : 

if* Until sufficient reports have been received to 
approximate a normal distribution, it probably would be 
deelreable to assume a mean and standard deviation for 
all raters and stake corrections of standards on that basis. 

G. Thought might also bo given to determining a 
percentage correction for caoh rating officer, based on his 
range as compared 'With the average range, for us© in lieu 
of a system such as that described in £ above. 

H. In constructing the graphic scale, the writer has 
formulated a suggested procedure for further research, 
using the graphic scale as a basic, provided the close 
cooperation of, say, 50 Marine officers could be obtained; 
theca arc: 

I. Intercorrelate the scores on characteristics 
listed in the graphic socle as suggested in paragraph 3 
above. 

2. Mtminate any characteristics whose correlations 

with total scores arc very low and whose correlations 
with other characteristics arc very high. 

5. Construct a modified check-list type of scale 



{notifies la that Iterae would be scaled under ouch char¬ 
acteristic rattier than scaled la a heterogeneous'sa&sssi 

1 

using Likert*® scaling tecUnique or a similar one* 

/Tens 

4* Draft the scale with the t r i-tlos mixed and the 
characteristic titles end definitions omitted# 

■A large emphasis has been placed on correcting raters* 
standards, and the writer wishes to emphasize this aspect 
once acre and say that, in his opinion, corrections are 
essential if the ratings of different raters are to 
approach comparability* 


1 r'"fl'*'"LlkertT "■& "le'ohaiqii¥ '" i ; ox' r ths Measurement of 
Attitudes* ~ 
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The usefulness of the murks you make on a rating scale 
depends entirely on you* The importance of these marks 
cannot be overestimated* The completed fitness report 
will b© used for: ■ .^\:'.v.’ : . V : ‘ : : 

1* determining the order of promotion of IFCO’s* 

2* Determining the caliber of 'SCO's In the Corps. 

3* Indicating where improvement may be cade in 
classification or recruitment polioies* 

This means that you will not only determine who 
tsill be eligible for promotion but that you will — 
to a large extent «~ determine the quality of ficers in 
the Corps as a whole; consequently, your markings must 
be nude as truly, carefully and accurately as possible* 

The type of rating scale used with the fitness report 
form la called the "Graphic Hating Scale** It is 
characterized by a lino for each characteristic being 
rated; under which arc arranged phrases descriptive of 
the characteristic possessed by an HGO* The mechanics 
of marking are set out at the end of those instructions* 
Here are some brief pointore, which, if kept in mind, 
should be helpful while you are in tha process of 
marking the scale:' 

1*. Allot yourself a definite time to do the rating 
and take plenty of it* Careful and considered judgment 


€4 


is essential to fair rating* 

2. Do it all yourself, neither ask for nor accept 

advice of others in mking marks* You cannot be con¬ 
sistent if you do* 

3* It is easier to rate the good characteristics 
than the bad, so take more tine on the bad ones* 

4. Your marks arc likely to be biased one way or 
the other when you are rating friends, old acquaintances, 
or persons whom you greatly like cr dislike. Be as open- 
minded as you can and base your marks on actual per** 
formane©* ' 

3* Some officers tend to rate consistently high or 
low* You must set and maintain your own personal stan¬ 
dard of rating* To do this, keep in nind that normally 
your rating will be distributed like this: 

Highest fifth -XOSt 

Next highest fifth 20,* 

Middle fifth 

tlext lowest fifth 20^ 

Lowest fifth 10» 

6* Your best ratings of KGO’s will come from long 
and thorough personal observations supplemented by notes 
you have taken during the observation period* But be 
sure that you record representative performance and not 
just outstanding good ox* bad examples; and watch your 
tendency to higher marks based solely on a very long 

acquaintance* 





7* You nay have a tendency to rat® certain charue- 
teristiea about the same regardless of the persona 
involved* You can help to offset tills tendency by 
thinking objectively of each characteristie In terns of 
performance. 

8. The ‘'halo effect” is the very common tendency 
to fora a general impression of a person and rat© him 
accordingly in a number of characteristics* This effect 
is minimised by rating all persona on one characteristic 
before going to the next characteristic* 

9. Your best rating trill be those of which you are 
sure and that is why you arc askoa to writ© in after 
each characteristic a very short description of repre¬ 
sentative performance* In addition this will help you 
to pin down the performance for yourself* 

10* Bo sure to re-read these instructions each time 
you have fitness reports to make end devise additional 
pointers of your own which will help you to make a fair, 
accurate and impartial rating. 

11* These are the directions for marking the scale; 

a* lor each numbered item, there is a question 
which indicates a characteristic which an KCO should 
possess. Underneath each question is a line representing 
the quantity of this characteristic an’I-TCO may possess; 
at one end is the lowest quantity and at the other end 





Is the highest quantity* In between the two ends of the 
line lie the various degrees of a characteristic* tiaderaeatb 
the line are phrases descriptive of the various degrees* 

These phrases are to-be used as a guide * 

b. To indicate the degree or quantity of a character¬ 
istic which you believe an KCO to possess, place a chock 
mark-at' the appropriate spot on the line* The chock may 
be anywhere on the lino. You do not have to place the ' 
check mark over a descriptive phrase, 

c* Work through one characteristic for all SCO’s 
before proceeding to the next characteristic* 

d* Write in the space provided on the rating sheet 
a very brief sample of the performance on which you base 
your judgment. 

q* If you have not observed a given SCO’s perfor¬ 
mance in a given characteristic, place a check mark in 
the blank following "no opportunity to observe"* Do not 
hesitate to use this blank if you have not had sufficient 
observation to for m a judgment* 

f. After you have worked through all the character¬ 
istics, sort them by NGQ’s and place the rating sheets 
for each If JO in his separate fitness report envelope* 
g* When the fitness report envelopes and rating 
sheets are all correctly completed, forward them in 
accordance with current instructions* 










1 


Name 



Last 


__Rank: 

First Middle initial 


Period Ending _ 

Day Month * Year 

Has this NCO been successful in obtaining the spirited, 
cheerful, and trilling obedience and cooperation of his men? 


Men" trio.3 
follow him. 
anywhere 


Handles' 
men well 



Usually 

gets 

cooperation 


of men 


Men have 
little 
confidence 
in him 


"Continual 

friction 

with 

subordinates 


No opportunity to observe_ 

Give specific illustrations of performance on which your 
judgment is based_ 



/ 


Name» " 

Last' 


period ending: 


First 

“pay Month 


'Mldult*'' 

Initial 


Rank 


Year 




2 . 


Has this NCO applied himself to the duties of his job, 
day in and day out? 


Never npares" Does*more* Does tne hvork ’ Needs’ - Lazy - heeds 

himself than assigned occassional constant 

expected to him prodding urging 


cf him 


No opportunity to observe; 


Give specific illustrations of performance on which your 
judgement is based:_ u r^A 

rXi 


tori:'- 








u 


3 


Name;_Hunk: 

Period Ending _ __ 


Day Montfc Year 

Has this NCO been loyal at all times to his superiors? 



Complete, 
unfailing 
energefiic 
support 


Actively 

supports 

his 

superiors 


;'-\rsu..liy 

stands up 
for 

superiors 


Carelessly 

criticizes 

superiors 


“’UoniTYnue lly 
gripes aoout 
superiors 


No opportunity to observe:_ 

Give specific illustrations of performance on which your 
judgment is based: 



Nome:__ __Rank:_ 

’ Las'S First Middle- 

Initial 

Period ending:__ 

Day lion tli Year 

Has this NCO boon loyal at ail times to his subordinates? 


Never says “Carelessly Usually."Actively 

a good word criticizes stands up supports 

about his men his men for his men his men 

No opportunity to observe_ 


Complete, 
unfailing 
onergetic, 
support 


Give specific illustrations of performance on which your 
judgement is based; _ __ _ 
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Name:_... 

j_:S £ C 

Pcrio.l ending: 






Middle 
mi via . 

Yean" 


Has this NOG fo’.ictc5 ins truetoons accurately, loernom 
ruadilv, ate set anted himself quickly, to new situations. 


> c optionally Oat-chos 

prick on easily 


■ Glow to 

catch on 


Dali 


No opportunity to observe:. 


Give specific illustrations of performance on which year 
j ad go men t is h a e o d: - -- 


6 . 


Name: 

Tas^""’ 

period ending; 


Rank: 


may 


Fire; 


Mon^c' 


Mi dells 
initial 


Year 


Has this NCG performed effectively in the absence of specific 
orders? 


Waits’tc 
be told 


Asks before 
taking action 


No opportunity to observe: 


Does most 
things right 
without 
being cold 


prompt in 
taking 
appropriate 
action 


Give specific illustrations of performance on which your 
judgement is based: 



70 . 


Fame: 


Rank: 

__Lest 

Hirst 

Middle 

Initial 

Perio'd onding:_ 




D~y Month 

Year* 


Has this NCO picked the right solution to problems 
confronting him? 


Cores up ' "Usually has More of ton Has;'trouble Seldom 

quicks” good answer right than finding a right 

with right ' wrong good answer 

answer 

Uc opportunity to observe:_ 

Give specific illustrations of performance- on which your 
judgement is based:_ 






8 , 


Name: _ 

""Last 

period ending 


R c-.rk: 


'Hirst 


Middle 

Initial 


"Day iToritfl Year 


Has this NOu narked in harmony with people in the 
organize tinf- 


Antagonizes 'irritates Conforms 


Pleasant Unusually 
to deal with helpful and 
considerate 


Ho opportunity to obsorvot_ 

Give specific illustrations of perform-nee on which your 
.judgement is based:______ 
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_ Tiaiiji'__ 

Middle*’ 

Ini tial 

Period ondi ng:__ 

Day jpiuaiife Year" 

Has this NGC favorably impressed others by his military 
appearance? 


Inspires Attracts 

Admiration Attention 

No opportunity to observe; 

Give «two ific illustrations on which your judgement is 
based‘ 


Unimpressive SiOgpy 






Namt;_ ... 

period cr-cUag* 



shorn drive in carrying out his duties? 



D; .:.5 ‘rb’ ’ ’~ Vigorous Active ~ ~ * ” Gives up 

easily 

No opportunity to observer.__ 

Give specific illustrations of o 
judge m, nt ~ i os: d:__ __ 


<'U '’inch your 





11 


Nano:_ _ 

Last ” Fi r 

Period end inf,_ 

J3a J ; _0 ; 1 U h 


_Hank 

Midrib " 
Initial 


Year 



Has this FCO demonstratod mastery of the technical 
knowledge necessary in his job? 


Insufficient Gets by Knows enough Well Has compl 

knowledge with for grounded knowledge 

difficulty satisfactory 
performance 

No opportunity to observe:_ 

Give specific illustrations of performance on v/hich your 
judgement is based:_ 



Name*:_ 

Last 

Period Fading: 


First Middle 
Initial 


Rank: 


Nay 


Month 



Has this KCO shown physical endurance under difficult 
cone i ti.*r o? 


■ iV-r.s' - Hard to Physically Tires Cun • t 

ready' .get him fit easily t,,lx 1 

for mere down 


No ot pa:*-or.nl ty to oh servo_ 

j-*/c illustraSions of performance on which your 

juuremen 4 is h ased*___ 


13 


’.'IRK g :___3-ink:_ 

Lest First Middle 

Initial 

period Gnding:_ 

'Day Month Year 

Has this 1TC0 shown that he can kcop his head during 
emergency? 


More clearheaded Reliable Loses his 

than usual • • head 

Mo opportunity bo observe:_ 

Give specific illustrations of performance on which your 
judgement is based: _._ 
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